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ABSTRACT 



A circuit and method color balance pixel signals (V PtxE£ ) 
on-the-fly in an image capturing system (10). The pixel 
signals are amplified in a programmable gain amplifier (204) 
whose gain is set by the ratio of a programmable capacitor 
(320, 330) to a fixed capacitor (310, 311). Control data 
(CONTROL) sets the capacitance of the programmable 
capacitor by enabling switches (323-324, 333-334) that 
enable binary weighted capacitors (321-322, 331-332). The 
control data adjusts the gain of the programmable amplifier 
as each pixel signal is applied, so that the pixel signals of all 
primary colors are amplified in the same programmable gain 
amplifier. 

9 Claims, 2 Drawing Sheets 
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COLOR BALANCING CIRCUIT AND 
METHOD 

BACKGROUND OF THE INVENTION 

The present invention relates in general to integrated 
circuits and, more particularly, to a color balancing circuit 
for processing imaging signals. 

High-resolution image capturing systems typically cap- 
ture an image by projecting light from the image onto an 
array of semiconductor photoactive sensing devices such as 
charge-coupled devices, p-i-n diodes or phototransistors. 
Such arrays operate at low power and are easily integrated 
on a semiconductor die, and so are ideal for use in portable 
equipment such as digital cameras and scanners. Each 
photoactive sensing device converts the light to a pixel 
signal. The system output provides image data containing 
intensity and color information for each pixel signal in a 
format displayable by a display device. 

Image colors are separated into three or four component 
primary colors by interposing a matrix of optical color filters 
between the image and the sensing array such that light of 
substantially one primary color reaches each photoactive 
device. For example, a system based on red, green and blue 
primary colors is commonly known as an RGB system 
which uses a matrix of red, green and blue color filters. 
Hence, each photoactive device senses light of one primary 
color to produce a pixel signal representing the primary 
color as well as the intensity of the light. The primary colors 
are blended by the display device to reproduce the other 
colors of the image. Where the display device is a high 
definition television, pixel signals are generated at a rate of 
at least 27.0 megahertz. 

On most systems, the response of photoactive devices to 
their respective primary colors is unbalanced, often due to 
the color filters. For example, devices that sense red light 
may produce pixel signals of greater amplitude than devices 
sensing blue light of the same intensity. If Ihe color imbal- 
ance is not corrected, the image is not displayed with 
accurate colors. 

To correct for the differences in color sensitivity, pixel 
signals of different primary colors are amplified by different 
gains to color balance the pixel signals. Prior art systems 
perform such color balancing by amplifying the pixel signals 
of each primary color in a different amplifier set to the 
appropriate compensating gain. For example, to color bal- 
ance a red pixel signal generated by red light and having 
twice the amplitude of a blue pixel signal generated by blue 
light of equal intensity, the blue pixel signal is amplified in 
one amplifier having twice the gain as another amplifier that 
amplifies the red signal. Such multiple amplifier color bal- 
ancing suffers from image display artifacts such as fixed 
pattern noise due to mismatches among the amplifiers. Such 
artifacts are difficult or impossible to identify and correct. 

Hence, there is a need for an improved circuit and method 
of color balancing pixel signals to compensate for differ- 
ences in the color response of photoactive sensing devices. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is an isometric view of an image capturing system; 
FIG. 2 is a block diagram of signal processing circuitry; 
FIG. 3 is a schematic diagram of a programmable gain 
amplifier; and 

FIG. 4 is a timing diagram of the programmable gain 
amplifier. 

DETAILED DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a partially exploded isometric view of an image 
capturing system 10 including an image capture device 20 
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and an output device 22. Image capturing system 10 captures 
an image 12 for converting to digital data in a format 
recognizable for displaying by output device 22, as 
described below. 

5 A package 24 for housing an imaging integrated circuit 26 
is enclosed by a lid 28 having a transparent portion 30 for 
projecting image 12 onto a region 32 of integrated circuit 26 
which includes an optical sensing array. The transparent 
portion is fabricated to operate as a focusing lens or, in the 

10 alternative, focusing is achieved with an external lens inter- 
posed between image 12 and region 32. The optical sensing 
array is organized as a matrix of photoactive semiconductor 
devices such as charge-coupled devices, phototransistors or 
p-i-n diodes functioning as pixel sensors. Light is projected 

15 through a matrix of color filters (not shown) such that each 
photoactive device produces an analog pixel signal indica- 
tive of the intensity and color of the projected light. Region 
32 further includes circuitry for selecting pixels in a pre- 
defined order to produce a stream of analog pixel signals on 

20 an output conductor 36. 

A region 34 of integrated circuit 26 includes a signal 
processing circuit which processes the pixel stream to pro- 
duce digital output data coupled through wire bond 37 and 
a lead 39 of package 20 to output device 22. Although the 

25 output signal is shown in FIG. 1 as being provided on a 
single lead to simplify the figure, in most applications the 
output data is provided on a bus to multiple leads of package 
20. Control signals such as clock and address signals are 
provided on a conductor or bus 38 by circuitry in region 34 

30 to control the electrical operation of the sensing array of 
region 32. 

Output device 22 is shown as a monitor, but can be 
another type of device such as a printer, a storage device 

35 such as a disk drive, etc. In a wireless communications 
device such as a pager or portable telephone, image captur- 
ing system 10 provides a modulation signal for broadcasting 
image 12 to a receiver. Hence, output device 22 can include 
a radio frequency oscillator to provide a carrier signal, a 

4Q modulator for modulating the carrier signal with the output 
data and an antenna for transmitting the modulated carrier 
signal. 

FIG. 2 is a block diagram of the signal processing circuit 
of region 34, including a correlated double sampling (CDS) 

45 circuit 202, a programmable gain amplifier (PGA) 204, an 
analog-to-digital converter (ADC) 208, a digital signal pro- 
cessor (DSP) 210, a memory circuit 212 and a timing 
generator 214. In the figures, elements having the same 
reference numbers provide similar functions. A pixel stream 

50 V pixel operating at a 27.0 megahertz is received on con- 
ductor 36. V PZXE £ includes analog pixel signals whose 
amplitudes indicate the amount of light projected onto the 
photoactive sensing devices in the optical sensing array. 
Because the structure of the color filter matrix is known, 

ss the photoactive devices can be mapped to their respective 
primary colors during device fabrication and the mapping 
data stored in a color lookup table or the like in memory 212. 
The lookup table includes the address of each photoactive 
device along with associated color information. In more 

60 complex systems, the physical location of each photoactive 
device within the array is also mapped and stored in the 
lookup table. DSP 210 controls access to the photoactive 
devices through the lookup table to produce V PIXE l as a 
color-interleaved stream of pixel signals. 

65 CDS circuit 202 operates as a switched capacitor sample - 
and-hold circuit which uses a standard correlated double 
sampling technique to sense each pixel signal twice, the first 
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time to establish a reference voltage and the second time to primary colors of ^ PIXEL through each stage of pixel signal 

produce a pixel voltage. The reference and pixel voltages are processing. For each pixel signal at each processing stage, 

subtracted to produce a proportional differential output DSP 210 knows the color and physical location of the 

signal V^-V^ Such differential signals increase noise originating photoactive device within the array. DSP 210 

immunity and the dynamic range of the system, which is $ controls color balancing by addressing a photoactive device 

especially important in portable equipment operating from a through the lookup table and providing the corresponding 

low battery supply voltage. CDS circuit 202 typically pro- CONTROL data when the pixel signal is applied to PGA 

vides a voltage gain to maximize the dynamic range within 204. By taking advantage of physical location information, 

a given power supply voltage. For example, in one embodi- DSP 210 can compute more refined CONTROL data to 

ment used in a portable communications device operating make other types of compensating adjustments to the gain of 

from a battery supply voltage volts, CDS circuit PGA 204. For example, DSP 210 can correct for optical 

202 provides a voltage gain of about 1.5. imperfections such as reduced light exposure at the periph- 

Timing generator 214 receives a reference clock signal ery of the sensing array by increasing the gain of pixel 

REFCLK operating at 13.5 megahertz and derives clock signals generated by peripherally located photoactive 

signals which are provided on a bus 206 for synchronizing ^ devices. As a further example, DSP 210 can be programmed 

operations of the image capture circuit. For example one to compute light levels from the imaging data to adjust the 

clock signal can be frequency synthesized using a voltage overall gain of PGA 204 to compensate for dim lighting 

controlled oscillator to operate at 216.0 megahertz to set the conditions, thereby providing electronic exposure control, 

time slots during which V PIXE l ^ sampled by CDS circuit Such computations are typically too complex to be per- 

202. A pixel clock signal operating at 27.0 megahertz 2Q formed on each cycle of V PDCE l> so the results are updated 

is provided on conductor 38 to control the pixel rate of the in a buffer register in memory 212 linked to the lookup table 

optical sensing array. for providing the CONTROL data at the pixel rate. 

PGA204 provides a digitally programmable gain to adjust Memory 212 is implemented as a read-only or random 

the color balance of pixel signals of V PJXEL to compensate access array of storage devices which store the lookup table, 

for the different color sensitivities of photoactive devices. M buffer register and software instructions and data used by 

Color balance is often referred to as white balance because DSP 210. While memory is accessed at the 27.0 megahertz 

white light includes all colors of light in equal intensities. frequency of \ FIXEL but can be updated at a slower rate to 

Hence, when the pixel signals of a captured white image are allow DSP 210 to complete computation such as those 

color balanced, the pixel signals have equal amplitudes described above to enhance the appearance of the image on 

regardless of their primary colors and the white image is 3Q output device 22. In some systems, the user-provided color 

correctly displayed. When pixel signals are not color balancing or other data is stored in memory 212 through an 

balanced, the image is not displayed with accurate colors, so external input (not shown) of either memory 212 or DSP 

that a white image is displayed as a color other than white. 210. 

Prior art color balancing circuits separate the pixel signals FIG. 3 is a schematic diagram of PGA 204, a switched 
by their primary colors for routing through multiple parallel 35 capacitor, pipelined programmable gain stage, including an 
amplifiers. However, such amplifiers are difficult to match to amplifier 302, fixed capacitors 31&-3U, programmable 
the degree necessary to prevent image display artifacts such capacitors 320 and 330, and switches 314, 315, 316, 317, 
as fixed pattern noise. The present invention avoids this 323-324 and 333-334. PGA 204 amplifies the stream of 
problem by generating V PJXEL as a single stream of pixel pixel signals in V PJXE l to produce a color balanced imaging 
signals whose primary colors are interleaved for serially 40 signal V OUT which is applied to the input of ADC 208. 
amplifying through a single amplifier. Color balancing is Typically, capacitors 310 and 311 are matching capacitors 
achieved by adjusting the gain of PGA 204 with CONTROL and programmable capacitors 320 and 330 are matching 
data mapped to each pixel signal and stored in the lookup capacitors. The gain of PGA 204 is set by the ratio of 
table of memory 212. DSP 210 synchronizes the CONTROL capacitances of programmable capacitor 320 and capacitor 
data to the corresponding pixel signal and produces the 45 310. Capacitors can be matched more accurately than 
CONTROL data on a bus 222 to the control input of PGA amplifiers, so the single amplifier approach of present inven- 
204. Hence, the gain is adjusted on-the-fly to compensate for tion color balances pixel signals without introducing the 
color imbalance as the colors of the pixel signals change. fixed pattern noise and other display artifacts which char- 
ADC 208 is a switched capacitor pipelined ADC that acterize prior art multiple color balancing amplifiers, 
converts the analog output signal from PGA 204 to repre- 50 Moreover, a single amplifier configuration uses less power 
sentative imaging data on bus 209. A sufficiently high data and die area than the multiple amplifiers of prior art systems, 
rate is ensured by configuring bus 209 to have at least as Other embodiments besides matching capacitors can 
many conductors as there are bits in the digital data pro- alternatively be used without departing from the scope of the 
duced by ADC 208. Thus, for eight-bit digital data, bus 209 present invention. For example, a continuous mode opera- 
has at least eight conductors. 5S tional amplifier can use programmable resistors to set the 

DSP 210 includes a microprocessor with support circuitry gain with control data, 

or similar software executable logic circuits to convert the Programmable capacitor 320 comprises an array of binary 

imaging data from ADC 208 to output data in a predefined weighted capacitors controlled by associated switches that 

format that can be read and/or displayed on output device close in response to the CONTROL data. In order to simplify 

22. DSP 210 can also execute a variety of other imaging 60 the description, only capacitors 321-322 and associated 

operations, such as gamma correction, image noise filtering, switches 323-324 are shown. Similarly, programmable 

pixel cluster averaging, color deepening, contrast capacitor 330 comprises an array of binary weighted capaci- 

enhancement, and data compression. The software ins true- tors controlled by associated switches that are enabled in 

tions for operating DSP 210 are stored in a region of memory response to the CONTROL data, but only capacitors 

212 operating as read-only or random access memory. 65 331-332 and associated switches 333-334 are shown. 

DSP 210 controls the addressing of the optical sensing Because most systems require at least eight bits of program- 
array and uses the lookup table in memory 212 to track the inability to accurately color balance pixel signals, program- 
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mable capacitors 320 and 330 typically include eight binary 
weighted capacitors associated with eight switches that are 
enabled in response to eight bits of CONTROL data. In 
general, if N bits of accuracy are needed, where N is an 
integer, programmable capacitors 320 and 330 include N 
binary weighted capacitors and switches enabled by N bits 
of CONTROL data. Where CONTROL data is not config- 
ured as a binary representation of the desired gain, a decoder 
circuit (not shown) is used to convert CONTROL data to 
binary weighted form for controlling switches 323-324 and 
333-334. The capacitances of programmable capacitors 320 
and 330 are set by the combination of capacitors 321-322 
and 331-332 whose associated switches 323-324 and 
333-334 are enabled. Programmable capacitors 320 and 330 
further include fixed capacitors 312 and 313, which establish 
minimum capacitances at the inputs of amplifier 302 to 
prevent excessive gain changes that reduce stability and 
introduce glitches at the output of amplifier 302. 

The operation of PGA 204 is seen by referring to the 
timing diagram of FIG. 4, showing the input signal V PP - 
V PN over two successive cycles (from two successive pixel- 
signals) of V PZXEX and the resulting color balanced imaging 
signal V ozrr The first cycle of V PP -V PN includes time 
periods T 2 and T 2 and the second cycle includes time periods 
T 3 and T 4 . The first cycle of V 0 ut includes time periods T 2 
and T 3 and the second cycle includes T 4 and T 5 . Assume that 
the successive pixel signals are generated by equal intensi- 
ties of white light with the first pixel signal (V fP -V w 
shown during T x ) representing a first primary color and 3° 
having a greater amplitude than the second pixel signal 
(Vpp-Vpjy shown during T 3 ) representing a second primary 
color, as shown. 

During T 1( the switches of programmable capacitors 320 35 
and 330 are enabled by first CONTROL data from the 
lookup table in memory 212 to set the values of program- 
mable capacitors 320 and 330. Switches 316 and 317 are 
closed to charge programmable capacitors 320 and 330 to 
the levels of V Pi > and V PN , respectively. Switches 314 and 40 
315 are open to put amplifier 302 in an autozero mode 
during which no output signal is provided. In one 
embodiment, capacitors 310 and 311 are discharged during 
this period by shorting both electrodes to ground using 
additional switches (not shown). 

During CDS circuit 202 is in an autozero mode and 
switches 316-317 are opened to prevent programmable 
capacitors 320 and 330 from being discharged by CDS 
circuit 202. Switches 314-315 are closed to operate PGA 50 
204 in a gain mode during which V 0 ut ^ valid. 

During T 3 second CONTROL data from the lookup table 
of memory 212 enables a different combination of switches 
to set programmable capacitors 320 and 330 to a lower 
capacitance, which increases the gain of PGA 204 to color 
balance the pixel signals. Switches 316 and 317 are closed 
to charge programmable capacitors 320 and 330 to the levels 



45 



55 



opened to operate amplifier 302 in an autozero mode. 

During T 4 , CDS circuit 202 is in the autozero mode, 
switches 316-317 are opened to prevent discharging pro- 
grammable capacitors 320 and 330, and switches 314-315 
are closed to operate PGA 204 in the gain mode during 
which V 0 ut i s valid. The increased gain of PGA 204 
produces a second V ocrr signal (during T a ) whose amplitude 
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is equal to the amplitude of the first V our signal, thereby 
compensating for the color imbalance of the pixel signals. 

By now it should be appreciated that the present invention 
provides a circuit and method of color balancing pixel 
signals in an image capturing system. Pixel signals respon- 
sive to primary colors are interlaced in a signal stream and 
amplified in a single programmable amplifier. The gain of 
the amplifier is set with control data which adjusts the ratio 
of programmable capacitance to fixed capacitance in the 
amplifier. The control data is altered when the primary color 
of the signal being amplified changes, thereby altering the 
gain of the amplifier to color balance the pixel signals. 
Because capacitors are more accurately matched than 
amplifiers, the single amplifier configuration improves color 
balancing to produce more accurate image colors. In 
addition, fixed pattern noise and other imaging artifacts are 
reduced in comparison to prior art systems, while reducing 
power consumption and die area. 

What is claimed is: 

1. An imaging circuit, comprising: 

a storage device for storing control data; 

an amplifier having a first input coupled for receiving 
pixel signals that have not been separated by their 
primary colors, a first output for providing an imaging 
signal, and a control input coupled to an output of the 
storage device for receiving the control data to program 
a gain of the amplifier, where a first value of the control 
data sets the gain of the amplifier for a first pixel signal 
and a second value of the control data sets the gain for 
a second pixel signal to color balance the first and 
second pixel signals; 

a first capacitor coupled between the first input and first 
output of the amplifier; and 

a first programmable capacitor coupled for sampling the 
first and second pixel signals at the first input of the 
amplifier and having a capacitance set by the first value 
of control data when the first pixel signal is received 
and by the second value of control data when the 
second pixel signal is received. 

2. The imaging circuit of claim 1, further comprising an 
optical sensing array including first and second photoactive 
devices responsive to first and second colors of an image to 
generate the first and second pixel signals, respectively, at an 
output of the optical sensing array. 

3. The imaging circuit of claim 2, wherein the optical 
sensing array further includes a third photoactive device 
responsive to a third color of the image for generating a third 
pixel signal at the output of the optical sensing array, where 
the first, second and third pixel signals are applied succes- 
sively to the first input of the amplifier and a third value of 
the control data sets the gain of the amplifier for the third 
pixel signal to color balance the first, second and third pixel 
signals. 

4. The imaging circuit of claim 1, further comprising: 

a second capacitor coupled between the second input and 
a second output of the amplifier; and 

a second programmable capacitor coupled to a second 
input of the amplifier and having a capacitance set by 
the first value of control data when the first pixel signal 
is received and by the second value of control data 
when the second pixel signal is received, the imaging 
signal being provided across the first and second out- 
puts of the amplifier. 

5. The imaging circuit of claim 4, wherein the first and 
second capacitors are matched and the first and second 
programmable capacitors are matched. 
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6. The imaging circuit of claim 5, wherein the gain of the 
amplifier is determined by a ratio of a value of the first 
capacitor to the value of the first programmable capacitor. 

7. The imaging circuit of claim 1, further comprising an 
analog to digital converter (ADC) having a first input 5 
coupled for receiving the imaging signal and an output for 
providing imaging data indicative of the imaging signal. 

8. The imaging circuit of claims 7, further comprising a 
digital processing circuit having a first input coupled to the 
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output of the ADC and a first output for altering a format of 
the imaging data to produce output data. 

9. The imaging circuit of claim 8, wherein the digital 
processing circuit has a second out put coupled to an input 
of the storage device for providing the first and second 
values of control data mapped to first and second colors 
represented by the first and second pixel signals. 

* * * * * 
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